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APPARATUS FOR RETRIEVING INFORMATION USING REFERENCE 
REASON OF DOCUMENT 

Background of the Invention 
5 Field of the Invention 

The present invention relates to information 
retrieval for retrieving information from documents, 
etc., and in particular an apparatus for identifying 
a reference reason and retrieving information using 
10 the reference reason if there is a referring /referred 
correlation between documents. 

Description of the Related Art 

Several technologies are proposed to search for 
15 a reference correlation if there is a 
referring/referred correlation between documents. Such 
technologies include the following Japan patent 
applications . 

(1) Japan Patent Laid-open No, 63-228221 (Mitsubishi 
20 Electric) 

The reference correlation between documents are 
stored, and retrieval is conducted based on some clue 
information using a fuzzy logical operation. 

(2) Japan Patent Laid-open No. 63-153630 (NEC) 

25 Documents having a common reference correlation 
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can be retrieved utilizing the ref erred-correlation 
between documents and using a reference document as 
a retrieval item. Documents having a common reference 
correlation are documents which have a common 
5 reference document and are considered to have an 
important correlation between them. 

(3) Japan Patent Laid-open No. 1-191258 (Ricoh) 

Both the text of a document and the name of a 
reference document automatically extracted from the 
10 text are simultaneously presented to simplify editing, 

(4) Japan Patent Laid-open No* 6-282534 (NEC) 

The fact that a specific document is cited is 
automatically notified to the user of the referred 
document . 

15 (5) Japan Patent Laid-open No. 7-311780 (Cannon) 

Documents related to a specific document are 
searched for based on a reference correlation. The 
search results are displayed in descending order of 
importance. The importance of a document is determined 

20 based on the reference frequency of the document. 

(6) Japan Patent Laid-open No. 8-272818 (New Nippon 
Steel) 

If a document is designated, documents related 
to the document are displayed, and further retrieval 
25 becomes possible by selecting the displayed document. 
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(7) Japan Patent Laid-open No* 9-146968 (Hitachi) 

Other documents which make a reference similar 
to that made by a specific document are searched for. 

(8) Japan Patent Laid-open No. 10-105572 (NEC) 

5 It is judged whether there is some correlation 

between documents using both a reference correlation 
and a keyword, and a document aggregate is generated 
based on the judgment. 

Fig. 1A shows such a conventional information 

10 retrieval system. This system comprises a retrieval 
apparatus 1, a full text database 2 and an reference 
correlation database 3. If a document is inputted, 
both a document which has a common reference 
correlation and a document which makes a similar 

15 reference are displayed as related documents. The 
retrieval unit 5 of the retrieval apparatus 1 
retrieves documents in the full text database 2, and 
the selection unit 6 of the retrieval apparatus 1 
selects related documents using the reference 

20 correlation in the reference correlation database 3. 

Information about related documents are 
displayed, for example, in a format shown in Fig. IB. 
If there are a plurality of related documents, for 
example, the related documents are displayed in 

25 descending order of importance. 
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In the applications other than 8-272818 and 10- 
105572 of the Japan patent applications described 
above, basically only alternative reference 
correlations are used* One of the correlations 
5 indicates that a reference is made and the other 
indicates that a reference is not made. 

In 8-272818, the positioning of a reference 
correlation is also displayed. In this case, some 
information must be attached in advance to the 
10 reference correlation by a human being. In 10-105572, 
it is judged whether there is some correlation between 
documents using both a reference correlation and a 
keyword . 

As described above, in the conventional arts, the 
15 alternative information of whether there is some 
correlation between documents is used as the 
correlation between documents. 

However, the conventional information retrieval 
system described above has the following problems. 
20 In 7-311780, related documents are displayed as 

important documents in the descending order of the 
reference frequency of documents. In this case, a user 
must judge the importance of documents individually 
according to the criterion uniquely provided by the 
25 equipment side. 
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In other conventional arts, reference correlation 
is displayed using the alternative information of 
whether a document is referred to, analysis is made 
from one viewpoint of "whether a document is 
5 important" for a specific document and documents are 
searched for, A retrieval system using such 
alternative information has the following 
disadvantages . 

( 1 ) The reason why a document is important cannot be 
10 provided to a user. 

( 2 ) Analysis made from one viewpoint of whether a 
document is important can indicate no correlation 
between documents, 

(3) Even if it is known what type of document is 
15 necessary, all related documents are displayed 

together . 

In such a system, if, for example, a scientific 
document is retrieved, a document which has no direct 
correlation to a topic, such as a document on a new 
20 technology, a document on widely used software, etc., 
are often displayed with higher rankings. In this 
case, these documents are often not documents that 
should be retrieved. The conventional system cannot 
avoid such a problem. 
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Summary of the Invention 

An object of the present invention is to provide 
an apparatus for identifying a reason why a document 
is referred to by a specific document and for 
5 efficiently retrieving a document using the identified 
reference reason. 

A reference reason identifying apparatus in the 
first aspect of the present invention comprises a 
referred document extracting device , a reference 
10 position extracting device, an identification device 
and an output device. 

The referred document extracting device extracts 
document information about a referred document from 
given document data. The reference position extracting 
15 device extracts information about a position where the 
referred document is cited in the document data. The 
identification device analyzes information extracted 
by the reference position extracting device and 
identifies a reason why the referred documented is 
20 cited. The output device outputs output information 
including both the information extracted by the 
referred document extracting device and the reason why 
the referred document is cited. 

An information retrieval apparatus in the second 
25 aspect of the present invention comprises a document 
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database, a reference correlation storage device, a 
retrieval device and an output device. 

The document database stores document data. The 
reference correlation storage device stores a 
5 reference correlation including a reason why the 
referred document is cited by a specific document. The 
retrieval device retrieves document data stored in the 
document database using the reference correlation 
stored in the reference correlation storage device. 

10 The output device outputs the retrieval result 
including the reference reason. 

A document classifying apparatus in the third 
aspect of the present invention comprises a referred 
document extracting device, a reference position 

15 extracting device, an identification device, a 
similarity identification device and an output device. 

The referred document extracting device extracts 
document information about the referred document from 
given document data. The reference position extracting 

20 device extracts information about a position where the 
referred document is cited in the document data. The 
identification device analyzes the information 
extracted by the reference position extracting device 
and identifies a reason why the referred document is 

25 cited. The similarity identification device calculates 
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a similarity between reference correlations, each of 
which includes a reason why the referred document is 
cited, for a plurality of pieces of document data and 
classifies the pieces of the document data. The output 
device outputs a classification result. 

Brief Descriptions of the Drawings 

Fig. 1A shows a conventional information 
retrieval system. 

Fig. IB shows a conventional display format. 

Fig. 2A shows the basic configuration of the 
present invention. 

Fig. 2B shows the configuration of a reference 
reason identifying apparatus. 

Fig. 3 is a flowchart showing the process of a 
document structure analysis unit. 

Fig. 4 is a flowchart showing the process of a 
bibliographical information analysis unit. 

Fig. 5 is a flowchart showing the process of a 
text structure analysis unit. 

Fig. 6 is a flowchart showing the process of a 
reference document analysis unit. 

Fig. 7 is a flowchart showing the process of a 
reference context analysis unit. 

Fig. 8 shows an example of a document. 
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Fig, 9 shows the first: reference correlation. 

Fig. 10 shows the second reference correlation. 

Fig. 11 shows the configuration of an information 
retrieval system. 
5 Fig. 12 shows the first display of the retrieval 

result. 

Fig. 13 is a flowchart showing a display process. 
Fig. 14 shows the second display of the retrieval 
result. 

10 Fig. 15 shows the configuration of an information 

presenting apparatus . 

Fig. 16 shows the third reference correlation. 

Fig. 17 shows the fourth reference correlation. 

Fig. 18 shows the fifth reference correlation. 
15 Fig. 19 shows the first time series. 

Fig. 20 shows the configuration of a keyword 
extraction apparatus. 

Fig. 21 shows a keyword using a reference 
correlation . 

20 Fig. 22 shows retrieval using a keyword. 

Fig. 23 shows the configuration of a document 
classifying apparatus . 

Fig. 24 shows the second time series. 

Fig. 25 shows the configuration of an information 
25 processing device. 
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Fig. 26 shows examples of storage media. 

Description of the Preferred Embodiments 

The preferred embodiments of the present 
invention are described in detail below with reference 
to the drawings. 

Fig. 2A shows the basic configuration of the 
present invention. In the first aspect of the present 
invention, the apparatus shown in Fig. 2A corresponds 
to a reference reason identifying apparatus, and 
comprises a referred document extracting device 11, 
a reference position extracting device 12, an 
identification device 13 and an output device 14. 

The referred document extracting device 11 
extracts document information about a referred 
document from given document data. The reference 
position extracting device 12 extracts information 
about a position where the referred document is cited 
in the document data. The identification device 13 
analyzes information extracted by the reference 
position extracting device 12 and identifies a reason 
why the referred documented is cited. The output 
device 14 outputs output information including both 
the information extracted by the referred document 
extracting device 11 and the reason why the referred 
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document is cited. 

For example, a referred document corresponds to 
a reference document, etc., cited in given document 
data, and the referred document extracting apparatus 
5 11 extracts document information, such as the title, 
the name of author, etc., of the referred document 
from the document data. The reference position 
extracting device 12 searches for a position 
(reference position) where the referred document is 

10 cited using the number, etc., of the reference 
document in the document data and extracts information 
about a chapter to which the position belongs, 
information about the character string, etc., in the 
neighborhood of the position, etc. 

15 The identification device 13 also identifies a 

reason (reference reason) why the referred document 
is cited in the position based on the extracted 
information about the reference position. The output 
device 14 relates the document information of the 

20 referred document to the reference reason and outputs 
the information. 

According to such a reference reason identifying 
apparatus, both the document information of the 
referred document and the reference reason are 

25 automatically extracted from document data and are 
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presented to a user. Therefore, the user can recognize 
why each referred document is cited by a referring 
document and estimate the importance of the referred 
document from the reference reason. The user can also 
5 retrieve a document using the reference reason. 

In the second aspect of the present invention, 
the apparatus shown in Fig. 2A corresponds to an 
information retrieval apparatus, and comprises a 
document database 15, a reference correlation storage 
10 device 16, a retrieval device 17 and an output device 
14. 

The document database 15 stores document data. 
The reference correlation storage device 16 stores a 
reference correlation including a reason why the a 

15 referred document is cited by a specific document. The 
retrieval device 17 retrieves document data stored in 
the document database 15 using the reference 
correlation stored in the reference correlation 
storage device 16. The output device 14 outputs the 

20 retrieval result including the reference reason. 

The document database 15 corresponds to, for 
example, a full text database and stores document data 
to be retrieved. The reference correlation storage 
device 16 stores information about the reference 

25 correlation indicating not only that a document is 
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cited by another document but also the reference 
reason. The retrieval device 17 retrieves document 
data in the document database 15 using the reference 
reason included in the stored reference correlation. 
5 The output device 14 outputs the information of the 
obtained document data based on the reference reason 
used for the retrieval. 

According to such an information retrieval 
apparatus, since the retrieved referred document is 

10 presented to a user together with the reference 
reason, the user can estimate the importance of the 
referred document from the reference reason. The user 
can also retrieve documents by designating an 
appropriate reference reason which meets his or her 

15 requirement, and thereby efficient retrieval can be 
implemented . 

In the third aspect of the present invention, the 
apparatus shown in Fig. 2A corresponds to a document 
classifying apparatus, and comprises a reference 
20 document extracting device 11, a reference position 
extracting device 12, an identification device 13, a 
similarity identification device 18 and an output 
device 14 . 

The referred document extracting device 11 
25 extracts document information about the referred 
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document from given document data. The reference 
position extracting device 12 extracts information 
about a position where the referred document is cited 
in the document data. The identification device 13 
5 analyzes the information extracted by the reference 
position extracting device 12 and identifies a reason 
why the referred document is cited. The similarity 
identification device 18 calculates the similarity 
between reference correlations, each of which includes 

10 a reason why the referred document is cited, for a 
plurality of pieces of document data, and classifies 
the pieces of the document data. The output device 14 
outputs a classification result. 

For example, if the reference reasons of a 

15 referred document cited in two pieces of document data 
are given, the similarity identification device 18 
calculates the similarity between the reference 
correlations by comparing the reference reasons. If 
in this way, the similarities of all pairs of document 

20 data in the plurality of the pieces of the document 
data are calculated, all pieces of the document data 
can be classified based on the similarities. The 
output device 14 outputs the information of the 
document clusters, etc. , as the classification result. 

25 According to such a document classifying 



apparatus, both the document information of the 
referred documents and the reference reasons are 
automatically extracted from a plurality of document 
data, and the plurality of document data are 
automatically classified based on the reference 
correlations. Therefore, a user can obtain the 
information of document groups classified based on a 
reference correlation, including a reference reason, 
and the user can also retrieve documents using the 
information . 

For example, the referred document extracting 
device 11 shown in Fig. 2A corresponds to both a 
document structure analysis unit 22 and a reference 
document analysis unit 25 shown in Fig. 2B, which is 
described later. The reference position extracting 
device 12 shown in Fig. 2A corresponds to both a 
document structure analysis unit 22 and a text 
structure analysis unit 24, which are shown in Fig. 
2B. The identification 13 shown in Fig. 2A corresponds 
to a reference context analysis unit 26 shown in Fig. 
2B. The output device 14 shown in Fig. 2 A corresponds 
to a correspondence identification unit 27, an output 
generation unit 28 and an output interface 29, which 
are shown in Fig. 2B. 

For example, the document database 15 shown in 



Fig. 2A corresponds to a full text database 2 shown 
in Fig- 11, which is described later, the reference 
correlation storage device 16 shown in Fig. 2A 
corresponds to a reference correlation database 95 
shown in Fig. 11 and the retrieval device 17 shown in 
Fig. 2A corresponds to a retrieval device 92 shown in 
Fig. 11. 

For example, the similarity identification unit 
18 shown in Fig. 2A corresponds to a similarity 
identification device 152 shown in Fig. 23, which is 
described later. 

Generally speaking, if a system is provided in 
advance with the feature data of a reference 
correlation as data on a reference reason (correlation 
data), it is possible to present the existence/non- 
existence of reference to a user, but it is impossible 
or very difficult to present a plurality of reference 
reasons to a user. However, if a system is provided 
in advance with a plurality of data on reference 
reasons, it is easy to present the existence/non- 
existence of reference and it is also comparatively 
easy to present a plurality of reference reasons to 
a user. Therefore, if data on reference reasons are 
stored in a system in advance, necessary information 
can be efficiently searched for using the data. 
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First, concerning the identification of a 
reference reason, a reason why a referred document is 
cited can be identified by analyzing the appearance 
position, reference method, sentence, etc., of the 
referred document in the referring document. In this 
analysis, for example, the following features are 
extracted . 

( 1 ) A referred document supplements information 
included in a referring document. For example, this 
feature includes a case where a referred document is 
a regulation and a referring document is an addition 
to the regulation. This feature also includes a case 
where a reference document is about the discovery of 
a star and a referring document is about new data, 
hypothesis, etc., on the star. 

(2) A referred document summarizes information on the 
field of a referring document. Such a referred 
document corresponds to a so-called thesis review, 
which is often cited in order to show the recent 
development of the relevant field. 

(3) A referred document is argued against by a 
referring document. 

(4) A referred document is a typical document written 
by a person who is mentioned in a referring document. 

The positioning in the relevant field of a 
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referred document can be obtained by processing a lot 
of documents in this way. 

Fig. 2B shows the configuration of a reference 
reason identifying apparatus. The reference reason 
identifying apparatus shown in Fig. 2B comprises an 
input interface 21, a document structure analysis unit 
22, a bibliographical information analysis unit 23, 
a text structure analysis unit 24 , a reference 
document information analysis unit 25 , a reference 
context analysis unit 26, a correspondence 
identification unit 27, an output generation unit 28 
and an output interface unit 29. 

First, the input interface 21 inputs document 
data 30 as text data. The document structure analysis 
unit 22 divides the inputted text data into three 
parts, which are a bibliographical information part, 
a text (body) part and a reference document part, and 
inputs the three parts to the bibliographical 
information analysis unit 23, text structure analysis 
unit 24 and reference document analysis unit 25, 

respectively . 

Then, the bibliographical information analysis 
unit 23 extracts document information, such as a 
title, an author name, etc., from the bibliographical 
information part and outputs the data. The text 



structure analysis unit 24 extracts both a chapter 
structure and a part where a reference document is 
cited from the text part and outputs the data. The 
reference document analysis unit 25 extracts document 
information, such as an author name, date of issuance, 
title, journal name, etc., from the description of the 
reference document part. 

Then, the reference context analysis unit 26 
analyzes a part where a reference document is cited 
in the text information, identifies a reference reason 
and outputs the reason. The correspondence 
identification unit 27 relates the part where the 
reference document is cited in the text part to the 
document information extracted from the description 
of the reference document part and outputs the 
correspondence . 

Then, the output generation unit 28 combines the 
document information outputted from the 
bibliographical information analysis unit 23, the 
reference reason outputted from the reference context 
analysis unit 26, the correspondence information 
outputted from the correspondence identification unit 
27 and the document information of the reference 
document outputted from the reference document 
analysis unit 25 into output data 31 and inputs the 
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data to the output interface 29. 

Then, the output interface 29 outputs the output 
data 31 to a display screen, etc. The output data 31 
include, for example, the title of the document data 
30 and a list of the combinations of a reference 
document and a reference correlation . 

Next, the detailed process of the reference 
reason identifying apparatus shown in Fig. 2B is 
described with reference to Figs. 3 through 9. 

Fig. 3 is a flowchart showing the process of the 
document structure analysis unit 22. Pattern data 
lists 41, 42, 43 and 44 contain information about pre- 
determined character string patterns and are stored 
in a storage device, which is not shown in Fig. 3. 

The document structure analysis unit 22 first 
reads the text data of a document (step SI), searches 
for a line including a matching pattern while 
referring to an introductory pattern ( introdution 
pattern) stored in the pattern data list 41 (step S2 ) 
and checks whether there is such a line in the text 
data (step S3). If a document is written in English 
or Japanese, for example, the following character 
strings are stored in the pattern data list 41 as the 
introductory pattern. 

1 Introduction 



1 . Introduction 
Introduction 

or 

i mmz 
i. ttDfttc 

i fSJ* 

as 

If there is a line which matches such a pattern, 
the document structure analysis unit 22 stores the 
first matching line position as PI (step S4). Then, 
the document structure analysis unit 22 checks whether 
there is a keyword pattern before the position PI 
while referring to keyword patterns stored in the 
pattern data list 42 (step S5 ) . As the keyword 
pattern, for example, the following character strings 
are stored in the pattern data list 42 if "***" is 
assumed to be an arbitrary keyword* 

keyword *** 

keyword: *** 

or 

^ — ry — ]< N *** 
^ — r/. — |< N : 

If there is a line which matches such a pattern, 
the document structure analysis unit 22 stores the 
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position (step S6). Then, the document structure 
analysis unit 22 checks whether there is an abstract 
pattern before the stored position while referring to 
abstract patterns stored in the pattern data list 43 
5 (step S7 ) • As the abstract pattern, for example, the 
following pattern information is stored in the pattern 
data list 43, 
Abstract 

A sentence of 20 words or more, which is not 
10 positioned at the beginning of a document 

If there is a line which matches such a pattern, 
the document structure analysis unit 22 stores the 
position (step S8 ) . Then, the document structure 
analysis unit 22 searches for a line containing a 
15 matching pattern while referring to reference patterns 
stored in the pattern data list 44 ( step S9 ) and 
checks whether there is such a line after the position 
PI (step S10). As the reference document pattern, for 
example, the following pattern information is stored 
20 in the pattern data list 44. 
Reference 

or 

##» 

25 If there is a line which matches such a pattern, 
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the document structure analysis unit 22 stores the 
position of the last matching line as P2 (step Sll), 
outputs the stored positions PI and P2 (step S12) and 
terminates the process. If in step S5 there is no 
5 keyword pattern, the document structure analysis unit 
22 performs the processes in and after step S7 without 
storing a position. If in step S7 there is no abstract 
pattern, the document structure analysis unit 22 
performs the processes in and after step S9 without 

10 storing a position. 

If in step S3 there is no introductory pattern, 
the document structure analysis unit 22 stores the 
start position of the document as PI (step S13) and 
performs the processes in and after step S9 . If in 

15 step S10 there is no reference document pattern, the 
document structure analysis unit 22 stores the end 
position of the document as P2 (step S14) and performs 
the process in step S12. 

The position PI which is outputted in step S12 

20 corresponds to the boundary position (break) between 
the description of the bibliographical information 
part and the description of the text part, and the 
position P2 corresponds to the boundary position 
between the description of the text part and the 

25 description of the reference document part. 
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Fig. 4 is a flowchart showing the process of the 
bibliographical information analysis unit 23 . Both a 
stop word list 51 and a pattern data list 52 contain 
information about pre-determined character string 
5 patterns and are stored in the storage device* 

The bibliographical information analysis unit 23 
first reads a part ranging from the beginning of the 
text data to PI as the bibliographical information 
part (step S21), and checks the text data while 

10 referring to the stop word list 51. If there is a 
sentence containing a stop word at the beginning of 
the text data, the bibliographical information 
analysis unit 23 skips the sentence (step S22), and 
extracts the next sentence as a title (step S23 ) . For 

15 the stop word, a character string that may appear at 
the beginning of a sentence which is not a title is 
used, and, for example, the following character 
strings are stored in the stop word list 51. 

mm 

20 

or 

Technical Note 

Then, the bibliographical information analysis 
unit 23 searches for and extracts a matching pattern 
25 from a sentence immediately after the sentence stored 
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as a title while referring to the patterns of an 
author name stored in the pattern data list 52 (step 
S24). For the pattern of an author name, for example, 
pattern information shown in Fig. 4 is stored in the 
5 pattern data list 52. In Fig. 4, "00" indicates an 

author name registered in a dictionary, and " " 

indicates an unknown word that is not registered in 
the dictionary. These patterns of an author name can 
also be expressed as follows. 
10 Author name + unknown word 

Unknown word + unknown word 

Alphabet, author name 

Alphabet, unknown word 

Alphabet, alphabet* author name 
15 Alphabet, alphabet, unknown word 

Then, the bibliographical information analysis 
unit 23 writes the extracted data in the storage 
device as a title and an author name (step S25) and 
terminates the process. 
20 Fig. 5 is a flowchart showing the process of the 

text structure analysis unit 24. Pattern data lists 
61 and 62 contain information about pre-determined 
character strings and are stored in the storage 
device. 

25 The text structure analysis unit 24 searches for 
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a pattern indicating chapter structure in the text 
inputted by the document structure analysis unit 24 
sequentially from the beginning and repeats the 
process of storing the position of such a pattern 
5 until there is no such pattern. Then, the text 
structure analysis unit 24 returns to the beginning 
of the text, searches for a pattern indicating a 
~ r Z g reference document and repeats the process of storing 

the position of such a pattern until there is no such 
*Z 10 pattern. Lastly, the text structure analysis unit 24 

fij outputs both the obtained chapter structure and the 

reference positions of reference documents. 
□ The text structure analysis unit 24 first reads 

U a part ranging from PI to P2 of the text data as the 

15 text part (step S31), and searches for a pattern 
-3 indicating chapter structure while referring to the 

pattern data list 61 (step S32). As the pattern of 
chapter structure, for example, the following pieces 
of pattern information are stored in the pattern data 
20 list 61, and lines which match these patterns are 
searched for. 

Numerals character string (carriage return) 
Numerals, character string (carriage return) 
In these examples, the numerals at the beginning 
25 of a pattern indicates a chapter number, and usually 
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it increases as the text data are read. If the size, 
thickness, etc., of a character are known in advance, 
the pattern of a chapter structure can be searched for 
referring to these pieces of information. 
5 Then, the text structure analysis unit 24 checks 

whether the numerals contained in a searched pattern 
increase appropriately (step S33). For example, if the 
numerals do not consecutively increase, the text 
structure analysis unit 24 judges that the numerals 
10 do not increase appropriately, performs an error 
handling process (step S34), and terminates the 
process. 

If the numerals increase appropriately, the text 
structure analysis unit 24 stores the position of the 

15 searched pattern as the start position of a new 
chapter (step S35), and checks whether there is a 
sentence remaining (step S36). If there is a sentence 
remaining, the processes in and after step S32 are 
repeated until there is no sentence remaining. 

20 If there is no sentence remaining, then the text 

structure analysis unit 24 sets a pointer to position 
PI (step S37), searches for a pattern indicating that 
a reference document is cited while referring to the 
pattern data list 62 (step S38 ) . As the pattern 

25 indicating that a reference document is cited, for 
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example , the following pieces of pattern information 
are stored in the pattern data list 62. 

Numerals ) 

[numerals] 

5 [character string name of era] 

Character string name of era 

If a part which matches any of these patterns has 
been searched for, the text structure analysis unit 
24 stores the position as a reference position, and 

10 checks whether there is a sentence remaining (step 
S39). If there is a sentence remaining, the process 
in step S38 is repeated until there is no sentence 
remaining* If there is no sentence remaining, the text 
structure analysis unit 24 outputs both the obtained 

15 start position of each chapter and the reference 
positions (step S40) and terminates the process. 

Fig* 6 is a flowchart showing the process of the 
reference document analysis unit 25. A pattern data 
list 71 contains information about pre-determined 

20 character string patterns and is stored in the storage 
device. 

The reference document analysis unit 25 reads the 
reference document part inputted from the document 
structure analysis unit 22 one sentence at a time and 
25 sequentially stores information, such as the matched 
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author name, date of issuance, title, journal name, 
etc. The reference document analysis unit 25 repeats 
such a process until there is no line remaining in the 
reference document part* 
5 The reference document analysis unit 25 first 

reads a part ranging from P2 to the end of the text 
data as the reference document part ( step S41 ) , and 
checks whether there is a sentence remaining ( step 

542) . If there is a sentence remaining, the reference 
10 document analysis unit 25 reads one sentence (step 

543) , compares the sentence with the reference 
document pattern of the pattern data list 71 (step 

544) and checks whether there is a matching pattern 
(step S45). As the reference document pattern, for 

15 example, the following pieces of pattern information 
are stored in the pattern data list 71. 

Author name and author name era name "title" 
journal name 

[author name era name] author name era name 
20 "title" journal name 

[reference number] author name era name "title" 
journal name 

If the read sentence matches such a pattern, the 
reference document analysis unit 25 stores 
25 information, such as the author name, era name, 
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journal name, etc., contained in the sentence as 
reference document information (step S46) and repeats 
the processes in and after step S42. If there in no 
matching pattern, the reference document analysis unit 
5 25 repeats the processes in and after step S42 without 
storing information contained in the sentence. If in 
step S42 there is no sentence remaining, the reference 
document analysis unit 25 outputs the obtained 
reference document information ( step S47 ) and 

10 terminates the process. 

Fig. 7 is a flowchart showing the process of the 
reference context analysis unit 26. The pattern data 
list 71 contains information about pre-determined 
character string patterns and is stored in the storage 

15 device. 

The reference context analysis unit 26 includes 
a language analysis unit 81 and a reference 
feature/reference reason correspondence table 82, 
analyzes information about both chapter structure and 

20 reference position inputted from the text structure 
analysis unit 24 and identifies a reference reason. 
This reference feature/reference reason correspondence 
table 82 is prepared in advance by a human being or 
by machine learning. The reference context analysis 

25 unit 26 identifies the reference reason for each 
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reference position based on three pieces of 
information: the information of a chapter containing 
the position, the result of the analysis of a 
character string in the neighborhood of the position 
5 by the language analysis unit 81 and the reference 
pattern of a reference document using the reference 
feature/reference reason correspondence table 82, 

The reference context analysis unit 26 first 
reads the text and its chapter structure (step S51) 

10 and checks whether all the processes of all reference 
positions are completed (step S52). If all the 
processes are not completed yet, the reference context 
analysis unit 26 reads the next reference position 
(step S53) and extracts both the number of a chapter 

15 to which the position belongs and a character string 
in the neighborhood of the position while referring 
to the chapter structure (step S54). 

Then, the language analysis unit 81 makes the 
morphemic analysis, syntactic analysis, semantic 

20 analysis, etc*, of the extracted character string and 
extracts the features of the neighborhood of the 
reference position (step S55). For example, for the 
morphemic analysis, the algorithm described on pages 
117-137 of the following document [1] is used, and for 

25 the syntactic analysis, the algorithm described on 
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pages 140-199 of the document: is used. For the 
semantic analysis, the algorithm described on pages 
200-231 is used. 

5 [1] Makoto Nagao, "Natural Language Processing", 
I wanami Shoten (1996) 

Then, the reference context analysis unit 26 
identifies a reference reason while referring to the 
10 reference feature/reference reason correspondence 
table 82 (step S56). As the reference reason, for 
example, the following reasons are considered. 

( 1 ) Answer 

A reference document is cited in order to 
15 describe an opinion different from the content of the 
reference document. 

(2) Application 

A reference document is cited in order to 
introduce the application field. 
20 (3) Basic 

A reference document is cited in order to 
introduce a basic research or the work of his or her 
predecessor. 
( 4 ) Contraposition 
25 A reference document is cited in order to 
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in-troduce an opinion against: a specific part of the 
content or a contrasting opinion. 

( 5 ) Human 

A reference document is cited in order to 
5 introduce the typical document of a specific person. 

( 6 ) Related work 

A reference document is cited in order to 
introduce a work related to a specific content. 

( 7 ) Review 

10 A reference document is cited in order to 

introduce the review of a specific field. 

( 8 ) Software 

A reference document is cited in order to 
introduce software used in a simulation, etc. 
15 ( 9 ) Technique 

A reference document is cited in order to 
introduce a technique used in an experiment, 
simulation, etc. 

(10) Weak correlation 

20 A reference document is cited in order to 

introduce a content which has a weak correlation to 
a specific content. 

(11) Similar 

A reference document is cited in order to 
25 introduce a content similar to a specific content. 
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The reference feature/reference reason 
correspondence table 82 stores a correspondence 
between the category of such a reference reason and 
a reference feature. This reference feature indicates 
5 the feature of the description method of a text 
expressing a corresponding reference reason and 
includes information, such as the number of the 
chapter containing the reference position of a 
reference document, the context of a character string 
10 in the neighborhood of the reference position, the 
reference pattern of the reference document, etc. In 
the case of the reference reasons described above, the 
following pieces of correspondence are stored in the 
reference feature/reference reason correspondence 
15 table 82 if is assumed to be a character string 

indicating a reference document. 

Reference position = Chapter 1 and Result of 
language analysis = negative expression -> Answer 

Context = "Although ... ** is popular, in this 
20 study ..." -> Answer 

Context = "This approach is used in ** ..." -> 
Application 

Reference position = Chapter 1 or 2 -+ Basic 

Context = "The first idea . . . due to **" or " In 
25 previous research ... **" -» Basic 
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Context = "Unlike previous ... **, new . . . " -> 
Contraposition 

Reference position = Chapter 1 and Context = "** 
in which . . . has been proposed" or "** in which . . . 
5 is proposed" -» Related work 

Context = "... is reviewed in **", "** reviewed" 
or "see ** for an overview" -> Review 

Context = "We use ... similar to **", "see ** for 
a similar ... approach" or "... is also implemented 
10 in **" -> Similar 

The reference context analysis unit 26 retrieves 
the reference feature/reference reason correspondence 
table 82 using the information extracted in step S54 
or the analysis result obtained in step S55 as a 
15 reference feature, acquires a corresponding reference 
reason and stores the reason (step S57). Then, the 
reference context analysis unit 26 repeats the 
processes in and after step S52. If in step S52 the 
processes of all reference positions are completed, 
20 the reference context analysis unit 26 outputs a 
reference reason for each reference position (step 
S58) and terminates the process. 

As described above, a reference reason is 
identified based on the features of an expression 
25 relating to a referred document in a referring 



36 

document. For this method of identifying a reference 
reason, a statistical method can also be used in 
addition to the method of storing the reference 
feature/reference reason correspondence table 82 
5 described above. Such a method is also known as 
"machine learning" . In this case, for the reference 
feature, the following features are used. 

( 1 ) Appearance frequency of a reference document 

(2) Reference position of a reference document: 
10 distance from the beginning of a document, chapter of 

appearance 

(3) Neighborhood information of reference position: 
a cooccurring word, a phrase frequently used 

A reason why a referred document is cited is 
15 prepared in advance as a correct answer for each of 
these reference features by a human being, and the 
reference feature extracted by a machine or human 
being is related to the reference reason. In this 
case, a plurality of sets consisting of a reference 
20 feature and a reference reason are prepared and a 
reference feature is related to a reference reason 
using a statistical method. For the statistical 
method, for example, a decision tree, a neural net, 
the nearest neighborhood method, Bayesian inference, 
25 etc., which are described on pages 525-652 of the 
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following document [2], are used. 

[2] S. Russell and R. Norvig, "Agent Approach 
Artificial Intelligence" , Kyoritsu Shuppan (1997) 

5 

Next, the operation of the reference reason 
identifying apparatus is described using a specific 
document as an example. Fig. 8 shows a document of 
"Jpn. J. Appl. Phys." in which a document of "Fujino" 

10 is cited as a reference document. 

First, if this document is inputted via the input 
interface 21, the inputted data are divided into three 
parts of bibliographical information (t Jpn. J. Appl. 
Phys. . . .KEYWORDS; . . . ) , a text ( 1 Introduction. . . ) and 

15 reference documents (Reference. . . K . Fujino, . . . ) by the 
document structure analysis unit 22. 

In this example, the dividing points PI and P2 
shown in Fig. 3 are set, respectively, immediately 
before a line beginning with "1 Introduction" in 

20 Chapter 1 and immediately after a line beginning with 
"Reference". Therefore, lines from the beginning to 
a line immediately before "1 Introduction", Chapter 
1 to Chapter 3 and lines after "Reference" correspond 
to the bibliographical information, the text and the 

25 reference documents, respectively. 
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The bibliographical information is analyzed by 
the bibliographical information analysis unit 23, and 
both the fact that the author of this document is Koji 
Tsukamoto et al.„ the fact that the title is 
5 "Morphology Evolution, . . " , etc., are identified- The 
text is analyzed by the text structure analysis unit 
24. As a result, the chapter structure is recognized 
and patterns, such as "6,8,10-13)" and -8,11,13)" are 

recognized as parts referring to reference documents 

10 in the text. 

Such a recognition result is outputted to the 
reference context analysis unit 26, and a reference 
reason is identified based on in what chapter/ 
sentence a reference document is cited. For example, 

15 if it is assumed that document 6) is cited four times 
and two times in Chapters 1 and 3, respectively, it 
is found that this document is cited relatively 
frequently. In this way, it is found that document 6) 
is an important document and is the base of the 

20 document shown in Fig. 8. 

Since documents 6), 8) and 10-13) are cited with 
an expression, "Some methods have been. . . .However, " 
it is found that these documents state opinions 
against the referring document. Since documents 8), 

25 11 ) and 13 ) are cited with an expression, "Similar 
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results were also reported. . . . ", it is found that 
these documents are similar to the referring document. 

The reference document part is analyzed by the 
reference document analysis unit 25, and document 
information about reference documents is extracted. 
For example, it is recognized that the author of 
document 6) is "Fujino", that the document was issued 
in "1991" and that the document is printed by "J. 
Electrochem. Soc. " . 

Then, an expression " 6) " indicating that document 
6 ) is cited and the document information of document 
6) is related by the correspondence identification 
unit 27. Then, all the pieces of information outputted 
by the bibliographical information analysis unit 23, 
reference context analysis unit 26, correspondence 
identification unit 27 and reference document analysis 
unit 25 are combined by the output generation unit 28 
and are outputted from the output interface 29. 

If a reference reason identified in this way is 
used, efficient retrieval can be implemented by 
retrieving a document using a reason indicating why 
a document is cited by another document. 

For example, Fig. 9 shows the data structure of 
a reference correlation obtained without using a 
reference reason. In this example, each alphabetical 
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character indicates one document r and an arrowed 
document is cited by an arrowing document. However, 
Fig. 10 shows the data structure of a reference 
correlation obtained using a reference reason. In Fig. 
10, not only referring/referred information between 
documents but also referring/referred information for 
each reference reason, are displayed. 

Fig. 11 shows a system configuration adopted when 
referring/referred correlation using the reference 
reason is stored in the reference correlation database 
in the conventional information retrieval system shown 
in Fig. 27. 

An information retrieval system shown in Fig. 11 
comprises an input device 91, a retrieval device 92, 
a display device 93, a full text database 94 and a 
reference correlation database 95, and the retrieval 
device 92 includes a control unit 101, a retrieval 
unit 102 and a selection unit 103. The reference 
correlation database 95 stores the information 
extracted by the reference reason identifying 
apparatus shown in Fig . 2 . 

If a document is designated by the input device 
91, the retrieval unit 102 retrieves the documents in 
the full text database 94 under the control of the 
control unit 101. Then, the selection unit 103 selects 
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another document which has a common reference 
correlation to the designated document and another 
document which has made a similar reference as related 
documents using the reference correlation in the 
reference correlation database 95, and the display 
device 93 displays these related documents. 

Fig. 12 shows an example of the display of such 
a retrieval result. It is assumed that the reference 
correlation 111 of the designated document is stored 
in the reference correlation database 95 and documents 
X, W, V, etc., are selected as related documents. In 
this case, a retrieval result 112 is displayed on a 
screen of the display device 93, and a mark "0" is 
described in the corresponding reference reason column 
of each document. In this example, "answer", 
"application", "basic" , etc., are presented as reasons 
why related documents are cited. 

Fig . 13 is a flowchart showing the display 
process of a retrieval result obtained by the system 
shown in Fig. 11. The selection unit 103 first reads 
the reference correlation data of a designated 
document from the reference correlation database 95 
(step S61) and reads a reference reason described in 
the data (step S62). Then, the selection unit 103 
reads the document information of a referred document 
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cited by the designated document, displays the 
retrieval result in a table format shown in Fig* 12 
( step S63 ) and attaches a mark to a corresponding 
reference reason column (step S64). 
5 Then, the selection unit 103 checks whether there 

are still reference correlation data, and if there are 
still data, the selection unit 103 repeats the 
processes in and after step S61. If all the reference 
correlation data of the designated document are 

10 processed, the selection unit 103 terminates the 
display process. 

According to such a display process, when an 
important document related to a specific document is 
displayed, not only order based on a single criterion 

15 (reference frequency), as shown in Fig. 28, but also 
a reason indicating why the important documented is 
cited, is explicitly displayed. Therefore, the 
retrieval result can be further narrowed based on the 
reference reason and as a result, efficient document 

20 retrieval can be implemented. 

Not only are related documents displayed in 
descending order of importance, but the related 
documents can also be classified according to each 
reference reason and can be displayed in descending 

25 order of importance, as shown in Fig. 14. In this 
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case, the importance of each document can be 
determined by taking the following factors into 
consideration, in addition to the importance ranking 
based on the single criterion described above. 

( 1 ) Individual reference reason 

(2) Reference frequency for a corresponding reference 
reason 

(3) Importance of a referring document 

(4) Importance of a source 

( 5 ) Reference frequency by a user 

If a user selects an appropriate reason among 
displayed reference reasons and retrieval is further 
designated, the retrieval unit 102 retrieves the full 
text database 94 while referring to the reference 
correlation database 95. Then, only a document cited 
for the designated reference reason is displayed as 
a related document. 

As described above, according to the information 
retrieval system shown in Fig. 11, a user can improve 
the efficiency of the information retrieval by 
attaching a reference reason to a retrieval result or 
by making a retrieval using the reference reason. 

Next, an information presenting apparatus for 
extracting and presenting information about a referred 
document is described. Fig. 15 shows the configuration 
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of such an information presenting apparatus. An 
information presenting apparatus shown in Fig. 15 
comprises an input interface 121, a retrieval input 
interface 122, a retrieval output interface 123, a 
5 reference reason identifying apparatus 124 and a 
reference correlation converting device 125 in 
addition to the constituent elements of the 
information retrieval system shown in Fig. 11. 

The input interface 121 inputs a plurality of 

10 documents (a document group) by which a specific 
document is cited and stores the documents in the 
entire database 94. Simultaneously, the input 
interface 121 supplies the reference reason 
identifying apparatus 124 with the documents. The 

15 reference reason identifying apparatus 124 has the 
configuration as shown in Fig. 2B, calculates the 
reference correlation of a given document and outputs 
the reference correlation to the reference correlation 
converting device 125. 

20 The reference correlation converting device 125 

converts a given reference correlation and stores the 
converted correlation in the reference correlation 
database 95. For example, as shown in Fig. 16, a 
reference correlation where documents B, C and D are 

25 cited by a document A for reasons b, c and d, 



45 

respectively, is assumed to be provided. In this case, 
as shown in Fig, 17, the reference correlation 
converting device 125 generates reference correlation 
data, as shown in Fig. 18, in addition to data 
indicating that documents B, C and D are cited by 
document A for the reasons b, c and d, respectively. 
Then, the reference correlation converting device 125 
stores these pieces of data in the reference 
correlation database 95. 

A user designates a keyword or document using the 
retrieval input interface 122 and conducts a 
retrieval. If information about a document obtained 
as the retrieval result is displayed by the retrieval 
output interface 123, the user further conducts a 
retrieval using the reference reason of the document. 

In both the retrieval input interface 122 and 
retrieval output interface 123, the following 
inputs/outputs are made. 

(1) If a user designates a document, the text of the 
document is displayed. 

(2) An interesting reference correlation is used as 
a filter. 

(3) A reference reason is explicitly displayed and a 
reference correlation is displayed. 

(4) The reference correlation is graphically displayed 
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using a GUI (graphical user interface) while 
explicitly displaying the reference reason, or 
changing the type of lines or arrows for indicating 
the reference correlation according to a reference 
5 reason. 

For example, Fig. 19 shows a case where a 
plurality of documents are arrayed in issuance order 
and the reference correlations between documents are 
displayed using arrows. In this example, a circle 

10 indicates one document, and a plurality of documents 
are displayed in a time series along the time 
coordinate. A referring document and a referred 
document are connected by a line type different for 
each reference reason. 

15 By using such a GUI, the positioning of each 

document in a complex reference correlation can be 
distinctly recognized and as a result, efficient 
document retrieval can be implemented. Furthermore, 
if the user designates a book mark in this display 

20 screen, the content of a corresponding document or the 
list of documents cited by the document can be 
displayed. 

Although in Fig. 19, reference reasons are 
distinguished by the line type of an arrow, the 
25 reasons can be distinguished by the color of an arrow 
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or can be displayed using a character string. 

Next, a keyword extraction apparatus using a 
reference correlation is described. Fig. 20 shows the 
configuration of such a keyword extraction apparatus. 
The keyword extraction apparatus shown in Fig. 20 
further comprises a keyword extraction unit 131, in 
addition to the constituent elements of the reference 
reason identifying apparatus shown in Fig. 2B. 

The text structure analysis unit 24 outputs an 
analysis result to the keyword extraction unit 131. 
The keyword extraction unit 131 extracts a keyword 
from a sentence in the neighborhood of a position 
where reference document is cited in the text, and 
outputs the keyword as the keyword of the reference 
document. In this case, output data 132 outputted from 
the output interface 29 include the combination list 
of the reference reason, reference correlation and 
keyword, in addition to the title of document data 30. 

According to such a keyword extraction apparatus, 
not only a keyword selected by the author of a 
document, but also a keyword based on another document 
citing the document, are provided. Therefore, not only 
a subjective keyword, but also an objective keyword, 
can be provided. 

Fig. 21 shows an example of a keyword using such 
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a reference correlation. In this example, "Machine 
Learning", "Decision Tree", etc., are provided as 
keywords by the author of a document, and a new 
keyword "Corpus" is extracted based on the context of 
another document citing the document and is added to 
the data structure of the keyword by the keyword 
extraction apparatus . 

Fig. 22 shows an information retrieval system for 
retrieving a document using a keyword provided in this 
way. The information retrieval system shown in Fig. 
22 further comprises a document keyword storage unit 
141, in addition to the constituent elements shown in 
Fig. 11. The document keyword storage unit 141 stores 
keywords with which the document are provided in 
advance, and the reference correlation database 95 
stores information extracted by the keyword extraction 
apparatus shown in Fig. 20. 

The retrieval unit 102 retrieves documents in the 
entire database 94 while referring to keywords in both 
the document keyword storage unit 141 and reference 
correlation database 95. The selection unit 103 
selects a related document using information in both 
the document keyword storage unit 141 and reference 
correlation database 95. In this case, the display 
priority is determined by taking into consideration 
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the matching degree of a keyword, the importance 
calculated based on a reference correlation and the 
frequency a document is accessed. 

According to such an information retrieval 
5 system, retrieval can be conducted using a keyword 
objectively provided by using a reference correlation 
in addition to a keyword provided in advance, and as 
a result, retrieval efficiency can be improved. 

A plurality of documents can also be classified 

10 using a reference correlation between documents. Fig. 

23 shows the configuration of a document classifying 
apparatus for classifying documents based on such a 
reference correlation. The document classifying 
apparatus shown in Fig. 23 comprises a reference 

15 correlation database 95, a keyword extraction 
apparatus 151 and a similarity identification device 
152. 

The keyword extraction apparatus 151 has a 
configuration as shown in Fig. 20, and extracts 

20 information, such as the reference correlation of a 
reference document, a keyword, etc., from a plurality 
of pieces of document data 1 53 and stores the 
information in the reference correlation database 95. 
The similarity identification device 152 compares 

25 reference correlations including reference reasons 
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between inputted documents, performs clustering based 
on the similarity between reference correlations and 
outputs document clusters 154. 

For example, if the similarity in reference 
correlation is calculated between documents a and b, 
the following equation is used. 



n a n b 



sim{a,b) = 




In the equation, sim(a, b) indicates the 
similarity between documents a and b. na and nb are 
the numbers of referred documents cited by documents 
a and b, respectively, rai and rbj are vectors for 
indicating citations by documents a and b, 
respectively, and each of rai and rbj has the 
attributes of a referred document and the reference 
reason (i = 1, 2,..., na, j = 1, 2,..., nb). 

6 (rai, rbj) is a function for indicating the 
similarity between rai and rbj. For example, it is 
defined in such a way that, if the same document is 
cited by both rai and rbj for the same reason, 6 (rai, 
rbj ) = 1 is satisfied, and if this is not the case, 
6(rai, rbj) = 0 is satisfied. Alternatively, if the 
same document is cited by both rai and rbj for 
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different reasons, 1 or 0.5 can be assigned to 6(rai, 
rbj ). 

As for referred documents, similarity is 
calculated by the same method, and the clustering of 
5 documents is performed based on the calculation 
result. In the document clustering, for example, the 
algorithm described on pages 436-438 of the document 
[1] described above is used. In this way, a plurality 
of documents of which the reference correlations are 

10 similar are classified into the same class. Clustering 
can also be performed by further adding the matching 
degree of a keyword, the appearance frequency of a 
word, etc., to such a similarity calculation. 

As described above, by classifying documents 

15 based on a reference correlation between documents, 
a user can obtain information about a document group 
classified from the viewpoint of reference 
correlation, including a reference reason. If a 
document is retrieved using the classification result, 

20 efficient retrieval can be implemented. 

Fig. 24 shows a case where the classification 
result of documents is used in the time-series display 
of a reference correlation shown in Fig. 19. In Fig. 
24, the vertical and horizontal coordinates represent 

25 the type of a document obtained by the classification 
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and time, respectively. According to such a display 
method, documents which have similar reference 
correlations are located close to one another, and as 
a result, reference correlations between a plurality 
of documents can be displayed so that they are easy 
to understand. 

Although in the preferred embodiments described 
above, a reference correlation between documents is 
processed, a reference correlation between a plurality 
of pieces of arbitrary information can also be 
processed. For example, if another type of text data, 
image data, audio data or program list is cited 
instead of a document, the reference reason of the 
respective information can be identified and can be 
used for information retrieval. 

The reference reason identifying apparatus shown 
in Fig. 2B, information retrieval systems shown in 
Figs. 11 and 22, information presenting apparatus 
shown in Fig. 15, keyword extraction apparatus shown 
in Fig. 20 and document classifying apparatus shown 
in Fig. 23 can be configured using an information 
processing device (computer) shown in Fig. 25. The 
information processing device shown in Fig. 25 
comprises a CPU (central processing unit) 161, a 
memory 162, an input device 163, an output device 164, 
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an external storage device 165 , a medium drive device 
166 and a network connection device 167, which are 
connected to one another by a bus 168. 

The memory 162 includes, for example, a ROM (read 
5 only memory), RAM (random access memory), etc., and 
stores both a program and data to be used for the 
process. The CPU 161 executes the program using the 
memory 162 and performs necessary processes. 

The input device 163 is, for example, a keyboard, 

10 pointing device, touch panel, etc., and is used by a 
user to input an instruction and information, the 
output device 164 is, for example, a display, printer, 
speaker, etc., and is used to output both a message 
and a process result. 

15 The external storage device 165 is, for example, 

a magnetic disk device, optical disk device, magneto- 
optical disk device, etc., and is used as the full 
text database 94 or reference correlation database 95 
shown in Fig. 11 or it is used as the document keyword 

20 storage unit 141 shown in Fig. 22. The information 
processing device can store both the program and data 
described above, and can use the program and data by 
loading them into the memory 162, if required. 

The medium driving device 166 drives a portable 

25 storage medium 169 and accesses the recorded content. 
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For the portable storage medium 169, an arbitrary 
computer-readable storage medium, such as a memory 
card, floppy disk, CD-ROM (compact disk read only 
memory), optical disk, magneto-optical disk, etc., 
is used. The user can store the program and data 
described above in the portable storage medium, and 
can use the program and data by loading them into the 
memory 162, if required. 

The network connection device 167 communicates 
with external devices via an arbitrary network (line) 
and transmits/receives data accompanying 
communications. The information processing device can 
receive the program and data described above via the 
network connection device 167, and can use the program 
and data by loading them into the memory 162, if 
required. 

Fig. 26 shows computer-readable storage media for 
supplying the information processing device shown in 
Fig. 25 with a program and data. The program and data 
stored in the portable storage medium 169 or external 
database 170 are loaded into the memory 162. Then, the 
CPU 161 performs necessary processes by using the data 
and executing the program. 

According to the present invention, a reason why 
information is cited can be identified by analyzing 
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a part of another piece of information in a document, 
etc., where the information is cited. If the reference 
reason of the information is presented to a user, the 
user can select an arbitrary desired reason among a 
5 plurality of pieces of reference reasons, and as a 
result, efficient information retrieval can be 
implemented. Furthermore, by presenting a reference 
correlation between a plurality of pieces of 
information using the reference reason, the 
10 positioning of each piece of information can be 
distinctly recognized . 
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What is claimed is: 

1. A reference reason identifying apparatus, 
comprising: 

5 a referred document extracting device extracting 

document information about a referred document from 
given document data; 

a reference position extracting device extracting 
information about a position where the referred 
10 document is cited in the document data; 

an identification device analyzing the 
information extracted by the reference position 
extracting device and identifying a reason indicating 
why the referred document is cited; and 
15 an output device outputting output information 

including the information extracted by the reference 
document extracting device and the reason why the 
referred document is cited. 

20 2. The reference reason identifying apparatus 
according to claim 1, further comprising 

a document information extracting device 
extracting document information about the document 
data from the document data, 

25 wherein 
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said output device outputs the information 
extracted by the document information extracting 
device together with the output information. 

3 . The reference reason identifying apparatus 
according to claim 1, wherein 

said identification device identifies the reason 
why the referred document is cited based on at least 
one of information about a chapter to which the 
position where the referred document is cited belongs 
and information about a character string in the 
neighborhood of the position where the referred 
document is cited. 

4. A keyword extraction apparatus, comprising: 

a referred document extracting device extracting 
document information about a referred document from 
given document data; 

a reference position extracting device extracting 
information about a position where the referred 
document is cited in the document data; 

an identification device analyzing the 
information extracted by the reference position 
extracting device and identifying a reason why the 
referred document is cited; 
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a keyword extraction device extracting keyword 
information of the referred document from information 
in the neighborhood of the position where the 
reference document is cited; and 
5 an output device outputting output information 

including the information extracted by the referred 
document extracting device, the reason why the 
referred document is cited and the keyword 
information . 

10 

5, An information retrieval apparatus, comprising: 

a document database device storing document data; 

a reference correlation storage device storing 
a reference correlation including a reference reason 
15 indicating why a referred document is cited by a 
specific document ; 

a retrieval device retrieving the document data 
stored in the document database device using the 
reference correlation stored in the reference 
20 correlation storage device; and 

an output device outputting a retrieval result 
including the reference reason. 

6. The information retrieval apparatus according to 
25 claim 5, further comprising: 
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a referred document extracting device extracting 
document information about the referred document from 
the document data of the specific document; 

a reference position extracting device extracting 
5 information about a position where the referred 
document is cited in the document data of the specific 
document ; 

an identification device analyzing the 
information extracted by the reference position 
10 extracting device and identifying the reason why the 
referred document is cited; and 

a device storing information including the 
information extracted by the referred document 
extracting device and the reference reason in said 
15 reference correlation storage device. 

7. The information retrieval apparatus according to 
claim 5, wherein 

said reference correlation storage device stores 
20 keyword information of the referred document extracted 
from the specific document, and 

said retrieval device retrieves the document data 
using the keyword information. 

25 8. The information retrieval apparatus according to 
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claim 5, wherein 

said output device includes a display device 
graphically displaying the reference correlation based 
on the reference reason. 

5 

9. The information retrieval apparatus according to 
claim 5, wherein 

said output device includes a display device 
displaying the reference correlation in a time series, 

10 

10. A document classifying apparatus, comprising: 

a referred document extracting device extracting 
document information about a referred document from 
given document data; 
15 a reference position extracting device extracting 

information about a position where the referred 
document is cited in the document data; 

an identification device analyzing the 
information extracted by the reference position 
20 extracting device and identifying a reason why the 
referred document is cited; 

a similarity identification device calculating 
a similarity in reference correlation including a 
reason indicating why a referred document is cited, 
25 between a plurality of pieces of document data, and 
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classifying the plurality of the pieces of the 
document data; and 

an output device outputting a classification 
result. 

5 

11. The document classifying apparatus according claim 
10, further comprising 

a keyword extraction device extracting keyword 
information of the referred document from information 
10 in the neighborhood of the position where the referred 
document is cited, 
wherein 

said similarity identification device classifies 
the plurality of the pieces of the document data using 
15 the keyword information. 

12. An information retrieval apparatus, comprising: 

a database device storing information to be 
retrieved; 

20 a reference correlation storage device storing 

a reference correlation including a reason indicating 
why referred information is cited by a specific piece 
of information; 

a retrieval device retrieving information stored 

25 in the database device using the reference correlation 
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stored in the reference correlation storage device; 
and 

an output device outputting a retrieval result 
including the reference reason. 

5 

13. A computer-readable storage medium on which is 
recorded a program enabling a computer to execute a 
process, said process comprising: 

extracting document information about a referred 
10 document from given document data; 

extracting information about a position where the 
reference document is cited in the document data; 

analyzing the information extracted by the 
reference position extracting device and identifying 
15 a reason indicating why the referred document is 
cited; and 

outputting output information including the 
information about the referred document and the reason 
why the referred document is cited. 

20 

14. A computer-readable storage medium on which is 
recorded a program enabling a computer to execute a 
process, said process comprising: 

retrieving document data stored in a document 
25 database using a reference correlation including a 
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reference reason indicating why a referred document 
is cited by a specific document; and 

outputting a retrieval result including the 
reference reason. 

15. A computer- readable storage medium on which is 
recorded a program enabling a computer to execute a 
process, said process comprising: 

extracting document information about a referred 
document from given document data; 

extracting information about a position where the 
referred document is cited in the document data; 

analyzing the information about the position 
where the referred document is cited and identifying 
a reason indicating why the referred document is 
cited; 

calculating a similarity in reference correlation 
including a reason why a referred document is cited, 
between a plurality of pieces of document data, and 
classifying the plurality of the pieces of the 
document data; and 

outputting a classification result. 

16. A reference reason identifying apparatus, 
comprising: 
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a referred document: extracting means for 
extracting document information about a referred 
document from given document data; 

a reference position extracting means for 
extracting information about a position where the 
referred document is cited in the document data; 

an identification means for analyzing the 
information extracted by the reference position 
extracting means and identifying a reason indicating 
why the referred document is cited; and 

an output means for outputting output information 
including the information extracted by the reference 
document extracting means and the reason why the 
referred document is cited. 

17. An information retrieval apparatus, comprising: 
a document database means for storing document 

data; 

a reference correlation storage means for storing 
reference correlations including a reference reason 
indicating why a referred document is cited by a 
speci f ic document ; 

a retrieval means for retrieving the document 
data stored in the document database device using the 
reference correlation stored in the reference 



correlation storage device; and 

an output means for outputting a retrieval result 
including the reference reason. 

18. A document classifying apparatus, comprising: 

a referred document extracting means for 
extracting document information about a referred 
document from given document data; 

a reference position extracting means for 
extracting information about a position where the 
referred document is cited in the document data; 

an identification means for analyzing the 
information extracted by the reference position 
extracting means and identifying a reason indicating 
why the referred document is cited; 

a similarity identification means for calculating 
a similarity in reference correlation including a 
reason why a referred document is cited, between a 
plurality of pieces of document data, and classifying 
the plurality of the pieces of the document data; and 

an output means for outputting a classification 
result . 



Abstract of the Disclosure 



The reference reason of a reference document is 
identified by analyzing a position where the reference 
document is cited in document data, a method by which 
the reference document is cited, a sentence in the 
document data, etc. Then, documents are retrieved and 
classified using a reference correlation including 
this reference reason. 
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